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NORMAN W. KETTNER,? 


Eye REPORT pertains to the sixth major 
study in a series of investigations de- 
signed to explore abilities considered to be 
important in the successful performance of 
high-level personnel. Previous studies had 
been concentrated on the areas of reasoning 
(Green, Guilford, Christensen, & Comrey, 
1953 ; Guilford, Christensen, Kettner, Green, 
& Hertzka, 1954), creative thinking (Wil- 
son, Guilford, Christensen, & Lewis, 1954), 
and evaluation (Hertzka, Guilford, Chris- 
tensen, & Berger, 1954). The study re- 
ported here was designed to consolidate and 
extend the findings of earlier studies, the 
three main objectives being: (a) verifica- 
tion of factors, some of which had been 
found only once previously; (6) clarifica- 
tion of the nature of certain factors; and 
(c) derivation of information leading to 
improvement of tests measuring the factors. 


General Plan of the Study 


The following major steps were involved 
in this study, in keeping with others under- 
taken in the project: 

1. Formulation of specific hypotheses 
concerning the factors involved in the area 
of thinking investigated and concerning 


1 Under Contract Noonr-23810 with the Office of 
Naval Research. The ideas expressed in this paper 
are our own and do not necessarily represent the 
opinions of the Office of Naval Research. Repro- 
duction in whole or in part is permitted for any 
purpose of the United States Government. Of the 
authors of this paper, J. P. Guilford is responsible 
investigator and director of the project, Paul R. 
Christensen was assistant director, and Norman 
W. Kettner was in direct charge of this particular 
study. For more detailed information see Guilford, 
Kettner, and Christensen (1954, 1956). 

2 Now with Planning Research Corporation. 
3 Now with System Developmeit Corporation. 
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their properties. 


Only testable hypotheses 
were seriously entertained. 


Selection, 


revision, and construction 
of tests that were believed to be suitable for 
testing the hypotheses. 

3. Administration of the tests to per- 
sonnel homogeneous as to sex and relatively 
homogeneous as to age, education, and gen- 
eral intellectual level. 

4. Factor analysis of the intercorrela- 
tions among the tests. 

5. Revision of original hypotheses, where 
needed, and formulations of new ones. 


Selection of Factors to be Investigated 


In the previous studies in the domains of 
reasoning, creativity, and evaluation, 31 
factors had been found. Eleven of these 
were reference factors, which have not been 
regarded as belonging within these domains. 
Of the remaining 20 factors, 11 were chosen 
for further investigation in this study. The 
selection was determined by several con- 
sideration». The foremost for in- 
clusion was the need for further informa- 
tion, particularly where prospects of 
obtaining new information seemed promis- 
ing. Some 


reasor 


factors were omitted because 
they were too weak in previous studies to 
be identified. Others were omitted because 
it was planned to investigate them more 
intensively in other studies than 
have been possible in this one. 


would 


The factors selected from the previous 
reasoning studies were eduction of per- 
ceptual relations, eduction of conceptual 
relations, eduction of conceptual patterns, 
eduction of correlates, and symbol manipu- 
lation. Factors from the creativity study 
were sensitivity to problems, associational 


fluency, orginality, and redefinition. Fac- 


I 
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tors from the evaluation study were facility 
with verbal relations and verbal classifica- 
tion. 

In addition, the following reference fac- 
tors were included: general reasoning, 
ideational fluency, logical evaluation, verbal 
comprehension, numerical facility, and 
judgment. 


HyPoTHESEs 
Testing Hypotheses by Factor Analysis 


Six of the 11 factors selected for investi- 
gation had appeared in only one previous 
study in this series. These factors needed 
to be verified; they are: eduction of con- 
ceptual patterns, associational fluency, orig- 
inality, sensitivity to problems, facility with 
verbal relations, and verbal classification. 
For each of these factors, in other words, 
the hypothesis that the factor exists was 
being tested. This was done by putting in 
the battery tests that were loaded on the 
factor in a previous study together with 
new and presumably improved tests de- 
signed for the factor, then seeing whether 
the factor would emerge again. 

Other hypotheses concerned the nature of 
each factor. For 8 of the 11 factors alter- 
native hypotheses were formulated. For 
most of the alternative hypotheses at least 
two tests each were constructed with the ex- 
pectations that they would help to make 
decisions between alternatives where that 
is possible. If the tests that were aimed at 
one alternative hypothesis have substantial 
loadings on a factor and the tests aimed 
at a second hypothesis do not, we may de- 
fine the factor as having the properties of 
the first hypothesis. If tests of two or more 
alternative hypotheses are all substantially 
loaded on a factor, the definition would 
need to include all the properties implied. 
In some instances, two alternative hy- 
potheses may actually represent two dif- 
ferent common factors, in which case two 
factors would probably replace the one 
formerly recognized. 

Tt will be seen in what follows that in one 
or two instances the same alternative hy- 
pothesis is stated pertaining to two different 
factors. In this case there is suspicion that 
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the two factors, previously found in dif- 
ferent analyses, may be one and the same. 
In such cases we were testing whether two 
such factors are, in fact, probably identical. 


Some General Background of the 
Hypotheses 


In general, alternative hypotheses were 
based upon consideration of results of 
previous studies. One alternative hypoth- 
esis for each factor was based upon the 
latest definition of that factor. Others 
might be other previously tested hypotheses 
that could not be rejected, or previously 
stated hypotheses not heretofore adequately 
tested. Still others represent new thinking 
regarding factors. 

Some of the hypotheses pertain to the 
degree of generality of factors. In our first 
and only acquaintance with the factor of 
sensitivity to problems, for example, the 
ability seemed to be much more restricted 
in scope than had been originally expected. 
The factor had been expected to apply to 
the sensing of almost anything in the en- 
vironment that is unusual, awry, challeng- 
ing, or bothersome. As things turned out, 
it did not reflect anything beyond appreciat- 
ing defects and deficiencies in mechanical 
and social devices. 

The factor of originality, on the other 
hand, proved to be more general than had 
been expected. Tests requiring diverse 
evidences of originality remained together 
in defining the factor. Some were scored 
for uncommonness or unconventionality of 
responses ; one was scored for cleverness of 
and others were scored for re- 
showing remote associations or 
far-fetched ideas in connection with stimuli. 
Both the sensitivity-to-problems factor and 
the originality factor were being reexamined 
for degree of generality. 

Other hypotheses pertain to the question 
of identity of pairs of factors found in 
different analyses. Associational fluency, 
found in the creativity analysis (Wilson 
et al., 1954), might be the same factor as 
the one called facility with verbal rela- 
found in the evaluation analysis 
(Hertzka et al., 1954). Redefinition showed 
some possibility of identification with the 


responses ; 


sponses 


tions 


il 


Air Force factor of judgment (Guilford & 
Lacey, 1947) in the creativity analysis but 
failed to show this linkage in the evalua- 
tion analysis. These points needed clarifica- 
tion and were expected to receive some 
clarification in this study. 

Two factors found in the evaluation 
analysis were given special attention in this 
study—facility with verbal relations and 
verbal classification. There was some doubt 
whether these should be regarded as evalu- 
ative abilities at all. The first of these was 
found related to a relatively long list of 
verbal tests. It might even have been identi- 
fied as the factor of verbal comprehension, 
except for the fact that another factor 
qualified for that identification. The lead 
ing test for facility with verbal relations 
was Controlled Associations, which had 
been included to serve as a marker for the 
factor of associational fluency. The ob- 
tained factor might have been a confound- 
ing of associational fluency with eduction 
of conceptual relations, the latter then re- 
garded as a reasoning ability. In the study 
being reported we should have the oppor- 
tunity to test these different interpretations, 
and, in fact, to see whether the same factor 
would emerge as such a second time. 

There was also doubt as to the status 
of verbal classification. In the first reason- 
ing analysis (Green et al., 1953), we enter- 
tained the hypothesis that there might be a 
separate ability to see identical elements in 
verbal entities. The common observation 
that classes are formed and class concepts 
are born would lend reasonableness to such 
a hypothesis. The hypothesis was proposed 
in connection with a group of ideas about 
inductive reasoning. Not enough classifying 
tests were included in the first reasoning 
analysis to determine whether there is a 
classifying ability distinct from an ability 
to see relations. So far as we know, then, 
both kinds of tests might be loaded with 
the same factor—eduction of conceptual 
relations. Thus, the factor called verbal 
classification in the evaluation analysis 
might have been eduction of conceptual re- 
lations, or it might have represented a new 
factor of ability to classify meaningful 
material. This study was expected to deter- 
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mine the status of the classifying-ability 
factor; whether or not it is separate from 
the relations-educing factor. 


A general logical problem arose in this 
study owing to the fact that we introduced 
a number of tests that involved the act of 
naming. In previous studies of tests calling 
for the discovery of relations, patterns, and 
classes, we had generally asked for multiple- 
choice responses indicating that these had 
been from the fact that the 
examinee did something revealing. This is 


discov ered 


an indirect way for the examinee 
that he has cognized the relation, 


to show 
pattern, 
or class. The additional step or steps might 
well bring additional common factors into 
the test variances. By asking the examinee 
to name or describe the relation, pattern, 
or class, it was thought that we should 
obtain a more direct indication of successful 
cognitions. 


It soon occurred to us that naming, itself, 
is an additional act and might also generate 
additional common factors. Another aspect 
of this problem would be whether, if the 
act of naming does entail something new in 
the way of factors, there would be one new 
naming 


factor, in common to all of the 
naming tests, or there would be several 


naming factors, each parallel to one of the 
discovery factors—that for discovering per- 
ceptual relations, that for conceptual rela- 
tions, and that for conceptual patterns—and 
perhaps, also, parallel to other factors. Con- 
sidering all the naming tests included in the 
battery, there were possibilities for all the 
way from none to as many as five naming, 
or verbalizing, factors to appear. 


Statement of the Hypotheses 


1. Eduction of perceptual relations had 
been found in tests composed of figural 
material and not in tests composed of mean- 
ingful words. Two kinds of 
involved: those 


figural tests 
involving seeing 
simple relationships as to form, position, 


were 


shading, and other properties and others 
involving the classification of figures ac- 
We 
tested the hypothesis that there 


cording to their properties. therefore 
is a single 
ability involving both relations and classes 


7 
: 
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of figural material or that there are two 
hypothetical factors: (a) seeing figural re- 
lations and (b) seeing figural classes. A 
hypothesis tested incidentally was whether 
tests involving the grouping of letters and 
spelling of words would also be related to 
one or both factors. 


2. Eduction of conceptual relations had 
had relatively low loadings in previous 
analyses, but there was little doubt of its 
existence as a factor. As in the case of the 
preceding factor, however, there was the 
question of whether one factor would suffice 
or whether it would take two: (a) seeing 
conceptual relations and (b) seeing con- 
ceptual similarities or seeing classes. 

3. Eduction of conceptual patterns 
seemed to call for something more than 
simple relationships. The term ‘‘patterns” 
had been used because it is sufficiently 
general to include principles, systems, rules, 
and perhaps trends. It had been designated 
as “conceptual” at the time this study was 
planned because the patterns were based 
upon combinations of elements in which 
figural properties were of little or no im- 
portance. Three alternative hypotheses 
were entertained in this study: (a) seeing 
patterns, (b) seeing rules or principles, and 
(c) seeing trends. 

4. Eduction of correlates was defined as 
the ability to find something that fits into 
a given relationship. Both conceptual and 
nonconceptual tests had been previously 
loaded on the factor. One important ques- 
tion was whether, if given the opportunity, 
conceptual and nonconceptual tests would 
split into two groups, indicating two dis- 
tinct but parallel abilities, as we had seen 
in a number of places. The leading test for 
the factor previously had included items in- 
volving relations between meanings and 
items involving relations between word 
structure or spelling. In the present study 
the two kinds of items were put in separate 
tests. The two alternative hypotheses were: 
(a) finding something to fit a perceptual 
relationship and (b) finding something to 
fit a conceptual relationship. 


5. Symbol manipulation was defined as 
the ability to manipulate symbols according 


to given rules. In another analysis a factor 
called “symbol substitution” was defined as 
the ability to substitute symbols according 
to rules. We had the question as to whether 
there is one factor or two. With added tests 
included in this study we had the oppor- 
tunity to answer this question and also to 
determine the main properties of either one 
or two factors. The hypotheses were: (a) 
symbol manipulation and (b) symbol sub- 
stitution. 


6. Verbalizing ability was suggested as 
a new factor (or group of factors), in 
accordance with the earlier discussion. We 
had eight tests in the battery that involve 
the naming or describing of discovered re- 
lations, of similarities or identical elements, 
of rules or principles, and of trends. We 
thought that there might be as many as five 
factors and we have accordingly five hy 
potheses: (a) naming perceptual relations, 
(>) naming conceptual relations, (c) nam- 
ing classes, (d) stating rules or principles, 
and (e) describing trends. Either c or d 
might divide two ways, depending upon the 
test content, whether figural or verbal. 

7. Sensitivity to problems had _ been 
found limited to two tests, involving me- 
chanical and social institutions, 
respectively, in the creativity analysis. Tests 
were added to determine whether the factor 


devices 


generalizes at all to nonmechanical and non 
social The only hypothesis tested 
here is with regard to the generality of the 
factor. 


areas. 


8. Associational fluency had been defined 
as the ability to produce words to meet 
specific requirements of meaning. The test 


Controlled Association, which called for 
12 synonymous responses to each item, 
strongly determined this factor in the 
creativity analysis. Another form of the 


same test, which called for only three re 
sponses to each item, failed to segregate the 
same factor in the evaluation analysis. Both 
forms of the test were included in the pres- 
ent study. We also had two tests that called 
for only one word per item. The two hy- 
potheses were: (a) producing one or two 


words to fit a given meaning and (>) pro- 


ducing several words to fit a given meaning. 


It might be found that a single factor 
would have both properties or two separate 
factors might be found. 


9. Originality was being tested for de- 
gree of generality, as stated earlier. Orig- 
inality tests had been constructed along 
three lines, involving the production of un- 
common, remote, or clever responses, re- 
spectively. All three kinds of tests had been 
loaded on the factor, but in this study tests 
were added in ways that should have given 
the opportunity for two or even three 
originality factors to emerge. The three 
hypotheses were: (a) production of remote 
responses, (b) production of uncommon re- 
sponses, and (c) production of clever re- 
sponses. 

10. Redefinition had been a rather weak 
factor in two prior analyses. It was defined 
as the ability to shift the function of an 
object or part of an object and use it in a 
new way. In this study we sought to deter- 
mine whether the factor could be verified 
and whether it could be distinguished from 
the judgment factor. As things turned out, 
conditions were not favorable for answering 
the second question. 


11. Facility with verbal relations, as in 
dicated earlier, was a factor of uncertain 
status. In this study we were merely in- 
terested in determining whether tests pre 
viously defining the factor would hang 
together as before or whether they would 
define two or more other factors, such as 
associational fluency and eduction of con 
ceptual relations. 

12. Verbal classificatian, found in one of 
our previous analyses, offered two logical 
possibilities. The factor was defined as the 
ability to appraise poorly defined verbal 
relationships. Here relation to a category 
or class is actually implied. The “poorly” 
was added because tests of the same charac- 
ter but having more clear-cut, logical rela- 
tionships did not have loadings on the 
factor. An apparently similar factor found 
by Adkins and Lyerly (1951) was defined 
as an ability to perceive abstract similarities. 
The two hypotheses are: (a) appraising 
poorly defined verbal relationships and (>) 
seeing conceptual similarities. 
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Summary of the Hypotheses and 
Reference Factors 


For convenience, the various hypotheses 
just stated are presented in outline form to 
serve as ready references in connection with 
later discussion of tests and factors: 

1. Eduction of perceptual relations 
(a) Seeing perceptual relations 
(b) Seeing perceptual similarities 


Eduction of conceptual relations 
(a) Seeing conceptual relations 
(b) 


Seeing conceptual similarities 


3. Eduction of conceptual patterns 
(a) Seeing conceptual patterns 
(b) Seeing rules or principles 
(c) Seeing trends 

4. Eduction of correlates 

(a) Finding something to fit a given perceptual 

relation 

(b) 


Finding something to fit a given conceptual 


5. Symbol manipulation 


(a) Symbol manipulation 
(b) Symbol itution 

6. Verbalizing al 
(a) Naming perceptual relations 
(b) Naming conceptual relations 
(c) Naming cl es 
(d) Stating rules or principl 


(e) g 
7. Sensitivity to problems 


8. Associational fluency 


(a) Producing one or two words to fit a given 
meaning 

(b) Producing several words to fit given 
meaning 


9. Originality 
(a) 
Producing uncommon re¢ 
(c) Produci 


Producing remote responses 
ponses 
clever 


responses 


10. Redefinition 

11. Facility with verbal relations 

12. Verbal 
(a) Appraising poorly defined verbal 


(h) Seeing ( mneeptual 


relations 
similarities 

Since many tests designed to test the 
hypotheses were known to contain or were 
suspected of containing common variances 
with factors outside this list, reference tests 
were added to the battery to isolate these 
sources of variance. The reference factors, 
numbered in sequence with those already 
listed, are: 
13. Ideational fluer 
14. General reasoning 


15. Logical evaluation 
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16. Verbal comprehension 
17. Numerical facility 
18. Judgment 


Tue Test 


The hypotheses were the main considera- 
tion in determining the kinds of tests that 
were selected for inclusion in this study. 
In those cases in which tests had to be 
adapted or new tests had to be constructed 
to fit the hypotheses, several other con- 
siderations were kept in mind. [ach 
was divided into at least two separately 
timed, comparable parts for purposes of 
convenient and meaningful estimation of 
reliability. Variance due to personal ex- 
periences of examinees was minimized as 
much as possible. An attempt was made to 
keep the factorial complexity of tests as 
low as possible. Before the assembly of the 
battery, new or adapted tests were pretested 
on samples of college students. On the 
basis of these results, 57 experimental tests 
were selected for inclusion in the analysis. 
It had been planned to include several of 
the Air Force tests, which are given to air 


test 


cadets routinely for classification purposes, 


to serve as markers for some of the ref 
erence factors. But by the time our battery 
could be administered, the Air Force had 
discontinued separate scoring of its classi 
fication tests, hence the test scores were not 
available to us. 

The tests are described in the following 
section. For convenience the tests are listed 
in alphabetical order. 
nature of the task is described and for most 
a sample item is given. Other information 
includes the number of separately 
parts, the number of items per part, and 
the working time. ; 


For every test the 


timed 


The code numbers of 
the tests indicate the following information 
The first letter, R, C, E, or P, indicates 
reasoning, creativity, evaluation, or plan 
The 
pair of letters) stands for a specific hypoth 
Next comes the number of the test 
in that category, 01, 02, etc. The last lette: 
indicates the form of the test, A meaning 
the first form, B the second, and so on. The 
uncoded bat 


ning, respectively. second letter (or 


esis. 


tests were taken over from 


teries given before the coding system was 
instituted. 


Description of Tests* 


1. Apparatus Test—CSO1B. A list of 20 imple- 
ments is presented. The E’s (examinee’s) task is 
to suggest two improvements for each of them 
Sample item: 

Suggest two improvements for the telephone. 

1. A device to record messages when no one ts at 
home 

2. Luminous dials to operate in the dark. 

Parts, 2. Items per part, 10. Working time, 14 min 


hfe 5 / 


2. Associations III—CN05A. The items consist 
of pairs of words. The E’s task is to think of a 
single word that is similar in meaning to both the 
given words. Since the given words are not 
synonyms, the word that E supplies must have a 
different meaning in relation to each of the given 
words 
Sample item 


1€ lte dex eive 


The correct answer is “lie” since it has a mean- 
ing similar to both given words. 


, 2. Items per part, 15. Working time, 12 min 


citations IV—CN06A. This test is made 
f words like those in Associations II] 
In this test, however, E's task is to think of a word 
that is associated with (not synonymous with) the 
given words and that has a different meaning in 
its relation to each of the given words 


2? 
5 “71353 


up Of pairs 


Sample item 


bell 


jewelry 
\ correct association word is “ring.” 
different meaning in its relation to 
It is a piece of jewelry and also the 


ring 


each of 
given words 


sound of a bell 


* The authors gratefully acknowledge permissiot 
test use and/or adaptation granted by the 
following authors or publishers: D. C. Adkins and 
Baier (Tests 31 and 56); R. I. Blakey (Tests 

and 18); L. L. Thurstone (Tests 9, 10, 23, and 
National for Social Studies (Test 

and the Ronald Press Company (Test 25) 

ts 13 and 44 were developed by the U. S. Air 

and Test 17 was developed by the U 
also 


Council 


lent 1S made fot 
Evening P 
We 


Lovell for makings 


Saturday 

- cartoons in Test 
nstance D 
| 


ber of classes in 


experimenta 


‘sized factor content. Se 
to the hypotheses 


; 
| 
Parts 
hfc, &a, 1] 
mission granted | 
and ( ier's to use ; 
Iso wish to thank ( 
? ivailable to us a nu inning 
psychology tor prelimina testing 
stands for hypothe 
preceding summary for | 
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Parts, 2. 
hfe, 9e. 


Items per part, 15. Working time, 14 min 


4. Cartoons—CN07A. Each item is a cartoon 
taken from old issues of Saturday Evening Post 
or Collier's. The E’s task supply clever 
“punch” lines for each of the cartoons. 


is to 


Parts, 2. 
hfc, Ve. 


Items per part, 8. Working time, 14 min 


5. Circle Reasoning (no code number). Each 
item consists of five rows of circles and dashes. 
One of the circles in each of the first four rows 
has been blackened according to a rule. The E's 
task is to find the rule and then mark the circle 
that should be blackened in the last row. 


Sample item: 


The second circle from the left in each row 
should be black; therefore, the second circle in the 
last row is marked to indicate that it is the one 
which should be black. 

Parts, 1. Items per part, 15. Working time, 8 min. 
hfe, 3a 


6. Completion of Figural Changes—RECO05A 
In each item a figure is given. Written instructions 
as to how the figure changes are also given. The 
E’s task is to draw a figure that shows the results 
of all the changes 


Sample item 


i | Change the circle to a square 
) 


to the inside. 


If the circle is changed to a square and a cross 
is put into the square, then the fi 
at the right is the correct answer 


Working time, 10 min 


rure that is drawn 


Parts, 2 


h fc, 4a 


Items per part, 10 


Consequences Test—CF06A (low-quality 
score). The E is to write what would happen if 
certain changes were suddenly to take place. He is 
to list as many different consequences or results of 
these changes as he can. 

Sample item 

What would happen if all national and loca 
were suddenly abolished ? 
1. No more parking tickets 


2. There would be more killing 


No more taxes 
Two scores are derived from this test. Tl} 


ity score is the number of direct responses 
ialit 


hose respot that describe direct or immedi: 


the given changes 


consequences 


Parts, 4. 
h fc, 13 


Items per part, 1. Working time, 8 min. 


score) 


Test—CF06A 


1oteness score 1s the 


onsequences 
The ret 
that is derived from the Consequences Test. It is 
the number of remote 


(remoteness 
second score 


those re- 
sponses that describe remote or far-reaching con- 


responses, Le 


sequences of the given changes 
Parts, 4. 
hfc, 9a 


Items part, 1. Working time, 8 min 


CAFOIB. In each 

a common word. His task is to 
ly synonyms as possible for each word, 
12 spaces being provided for each word. 


9 0 lled Associations 
item / 
write as m 


Sample item: 

GOOD righ 
excellent 
superior 

commendable pious 


virtuous 
noble 
worthy 


deserving 
pleasing 
creditable 
admirable 
Parts, 2 
hfc, 


Items per part, 4. Working time, 14 min. 

10. Controlled Associations II—CAF02B. The 

format of this test is the same as Controlled Asso- 

ciations, CAFOIB, except that E may give only 

three synonyms for each given word 

Sample item 
ODD: unusual 

unique 

yucer 

Parts, 2. Items per part, 10 

htc, 8a, 8b, 11 


Working time, 6 min. 


11. Correlate Completion II—RECO01A. Each 
item consists of two pairs of words and a single 
word. The E’s task is to supply a word that bears 
the same relation to the single word as the relation 
The rela- 
pair is based on the 
words and not on their meanings 


between the words in the first two pairs 
etween the words 


‘ture of the 


in eacl 


le items 


am ma not ton tool 


2. enrage rage correlate 


late 


2. Items per part, 20. Working time, 12 min 


Parts, 2. 
hfc, 4a 


ELO5A 
taken from 
“Letters to the 


is E’s task to designate those 


The state- 
the section 
Editor.” It 
statements (A) based 
prejudice, and those (B) 


onoht 
ught 


12. Critical Evaluation 
ments of this test have been 


of newspapers entitled 


primarily on emotion or 


showing reasoning and t 


Sample items 

1. All people who drink hard liquor should have 
driver's licer taken away 

The police should revoke the 
people who d > drunk 


their 


licenses of those 


Working time, 5 min 


©0®0-00-000-00-0 
-O0-@-0000-000-- 
9-@0-00-000-000 
©0@®-00-0--0000-0 
O-KO-0-00-0000- 
| a 
loot 
——— : 
( ie. Answers: 1. A, 2. B ; 
hfc, 12a 
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13. Figure Analogies—RPRO4A. The E’s task 
is to select a figure that bears the same relation to 
the third figure as the second bears to the first. 
Sample item: 


x Y B c D E 


GUILFORD, anp P. R. 


) 


Sloe 


Answer: A, 


Parts, 2. Items per part, 15. Working time, 10 min. 
hfe, la, 4a. 


14. Figure Analogies Completion (no code num- 
ber). This test is the same as Figure Analogies 
RPRO4A except that E must draw the figure that 
completes the second pair in accordance with the 
relation given by the first pair. 


Sample item: 


Parts, 1. 
hfe, 4a. 


Items per part, 15. Working time, 10 min 


15. Figure Classification—EF01A 
defined by groups of three figures. 


Classes are 
Single figures 
have to be assigned to these classes in terms of 
common characteristics. There are three 
five classes and five single figures have to be classi 
fied for 


sets of 


each set. 


Sample item: 


It 


\nswer: 


Parts, 1. 
h fc, 1b 


16. Figure Matching—EFO04A. In each item a 
geometrical figure is given along with a set of 
five other figures. The E's task is to select the 
ficure from the set that has most in common with 
the key figure. 


Items per part, 15. Working time, 6 min 


Sample item: 


Items per part, 15. Working time, 


I7 Figure Matrix (no code number). In eacl 
item nine squares are presented with figures th 


hange in both directions. Some squares are left 


CHRISTENSEN 


empty. The £ indicates which one of five alternate 


figures goes in an indicated square. 


pe 


Sample item: 


OO 


OS® 


A c D 
Answer: E 


Parts, 1 


Items per part, 15. Working time, 7 min. 


In each 
In addition, 
e showing how these forms can be combined 
is given. On the basis of this table, E is to find a 
form that is equal to the three given forms 


18. Form Reasoning (no code number). 
three familiar forms are given. 
] 


il 


answer 1s found in the following manner. 
ing to the table above, the first two figures 

the star and circle—are equal to a square 

if a square is put in place of the star and 

then a square and Accord- 

o the table a square and a cross are equal to 


TI erefore, the correct 


a cross remain. 
answer is a 


Items per part, 20. Working time, 2 min 


CRO3A. In each 
The E's task is to 
given objects the one that would 

solving the problem. 

TO START A FIRE 
B. onion C. pocket watch D, light 
ball 


Transformation 


is presented 


fountain pen 
E. bowling 
Best answer: C 
Parts, 2. Items per part, 10. Working time, 10 min 
hfe 10 


8 
Table 
vy cb 
I — A | CO-8 
Sample ter 
cir¢ 
Parts, 
h fc ch 
19. Gestalt 1 
[ 7} ~ tem a problem 
\nswer i Sample item : 
hfe, 1h 
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20. Inference Test—RDO3B. Each item presents 
a statement of fact or opinion, such as might be 
found in a newspaper, and five alternate con- 
clusions. The E indicates which of these can be 
drawn with most justification, 
Sample item: 

Most of the trees in the forest are green 
A. There are no yellow trees in the forest. 
B. There are some yellow trees in the forest 
C. Some of the trees in the forest are green 
LD). Green trees are the tallest in the forest. 
EK. Pine trees are green. 
Answer: C 
Parts, 2. 
hfe, 15 


Items per part, 8. Working time, 10 min 


21. Inventive Verbal Relations—RECO07A. In 
each item a different relationship is stated. Two 
words are then given. The E’s task is to produce 
two words that bear the specified relationship to 
the given words 
Sample item: 

(a) is the opposite of (b) 
(a) black: (b) white (b) weak 


Items per part, 15. Working time, 8 min 


(a) strong: 


Parts, 2 


hfe, th 


22. Letter Grouping—RPSO1A. In each item 
four groups of four letters each are given. Three 
of the groups are alike in some way. The E’s task 
is to pick out the group of letters that is different 
from the other three 
Sample item: 


AABC ACAD ACFH 


Items per part, 20. Working time, 8 


AAC( 


Parts, 2. 


hfe, lb 


Letter Series 
of a series of letters. 


RCP03A. Each item consists 

The E's task is to find the 
rule for the series and write the next two letters 
in the series 


E F E F E F E 


2. Items per part, 15. Working time, 8 min 


Parts, 2. 
hfe, 3h 

24. Letter Triangle—RCPO0IB. Each item con- 
sists of a series of letters arranged in triangular 
form with various letters left out. The £’s task 
is to determine which letter goes into the blank 
space indicated by the question mark 


Sample item 


Answer: C 


Parts, 2. Items per part, 8. Working time, 12 min 


hfe. 3a 


ELO7A 


25. Logical Classification 
consists of statements 


This test 
‘ought.” The 
has to classify these statements in terms of cate- 


containing 


gories, which are defined and for which examples 
are given 
Sample item 

You ought not to cross the street against the red 
light 

A. custom B. completeness C. safety 
EK. welfare 


D. utility 


Answer: C 
Parts, 2. Items per part, 25 
hfe, 10, 11, 15 

26. Matrix Ord 


of a 3 x 9 matrix ot 


Working time, 14 min 


PRO1A 


words 


ach item consists 
The k's task is to 
three words that 
time. He is also 
to indicate the direction of the sequence by arrow 
le 


line 
represent a Sequence in 


draw a straight through 


space or 


Sample items 


A. run think 
read ite 
walk peblish 


tank 


want 
sleep 


book 


cloth 
are 


accident 
valley in 


mixmaster 


Parts, 2. Items per part, 15 


hic, 


Working time, 18 min 


27. Number Series—RCP05. In 
series of numbers is given 
the rule for the 


it in the given blank 


each item a 
is to find 


scription 


*s tasl 


a ce 


series ane 


Sample item 


15 18 21 24 »7 30 


e, 12 min 


Items per part, 20. Working tin 


, Od 


Parts, 2 


28. Object Synthesis—CY0O1RB 


given 


1 item the 
names of two objects are "s task is 
to think of something that he made by 
combining the two objects 

mple item 


Possible answer 


ball 
punching b 


Working time 


volley steel spring 


Parts, 2 
hte, 10 


Items per part, 12 10 min 

29. Perceptual Relations 
each item two pairs of figures are 
task is to state 


RPRO3A. In 
The E's 


figure ot 


Naming 
given 
the relation that the first 
each pair bears to the se ond 


ple 


(a) ras 
a) O (b) C) 


Parts, 2. Items per part, 14 
la, 6a 


Working time, 14 min 


| 9 
| 
¥ 
B. 
| 
Sample item 
E 
a A. h 
def 
D. f 
— Ea, sa thom 
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30. Picture Classification—EF03A. Classes are 
defined by groups of three pictures each. The E's 
task is to assign single pictures to these classes in 
terms of common characteristics. 


Sample item: 


6 


Answers: - B, II - A. 


Parts, 2. Items per part, 15. Working time, 13 min. 
hfc, 2b, 12b. 


31. Picture-Group Naming—RCS03A. Each 
item is a group of five pictures of objects that 
are alike in some way. The E’s task is to provide 
a class name for each group. 


Sample item: 


Oy + 


Parts, 1. Items per part, 24. Working time, 6 min 
hfc, 2b, 6c, 12b 


32. Plot Titles—CFO02C (cleverness score). In 
the Plot Titles test, four story plots are presented 
The E is instructed to write as many clever titles 
as he can for each plot. The cleverness score is 
the number of responses that are rated clever. 


Parts, 4. Items per part, 1. Working time, 12 min 
hfc, 9c 


33. Plot Titles—CF02C (low-quality score) 
The low-quality score is the number of responses 
that are rated “not clever.” 


Parts, 4. Items per part, 1. Working time, 12 min. 
hfe, 13. 


34. Prescribed Relations—RSMO03B. In each 
item one figure is given. Written instructions as to 
how the figure is to be changed are also given 
The E’s task is to pick out from five given alter- 
natives the figure that shows the results of all the 
changes. 


Sample item : 


Cirale changes to square 


Answer: C. a 5 


Parts, 2. Items per part, 10. Working time, 10 min 
hfc, 4a. 


35. Quick Response—CNO1A. This test re- 
sembles the conventional word-association test. A 
list of words is read to the examinees at the rate 
of one every five seconds. The E is instructed to 
write down the first word that comes to him. 

The test is scored by assigning a weight to each 
response where weights are directly proportional 
to infrequency of occurrence in the population, and 
summing the weights. 


Parts, 1. Items per part, 50. Working time, 4.2 min. 
hfc, 9b. 


36. Remote Verbal Similarities—RCS02B. In 
this test E’s task is to select a word from five 
alternatives that has most in common with a given 
word, where all connections are rather remote. 


Sample item: 


FATHER A. candidate 
B. second baseman 
C. agitator 
DD. superintendent 
salesman 


Answer: D. 


Parts, 2. Items per part, 15. Working time, 10 min. 
hfc, 9a, 12a 


37. Seeing Deficiencies—PJ01A. In each item 
a short description of a plan or activity is given. 
The £’s task is to point out how the plan is faulty. 
Sample item 


A growing city discovers pressing needs to im- 
prove both its streets and its sewer systems. After 
due consideration, the council decides to work on 
the street-improvement program first. What is 
wrong with this plan? 

The streets will have to be torn up again for the 


Sewer system, 


Parts, 2. Items per part, 10. Working time, 20 min. 


Bac. 


38. Seeing Problems—CS06A. In each item the 
name of a common object is given. The £’s task 
is to write down five problems that might arise in 
connection with the object 
Sample item: 

CANDLE: A. How to light it 

B Fa 


Keeping it from falling 
Keeping tt from flickering 


D, How long will it burn 
E. What to do with the drippings 


Parts, 2. Items per part, 6. Working time, 8 min 


hte, 7, 13. 


39. Seeing Trends—RI06A. The items in this 
test consist of a group of words that tend to change 
progressively in some meaningful way. The E’s 
task is to discover the trend in the words. 


| 
| 


Sample item: 
Mouse rat lion pig cow horse elephant 


Animals become larger. 


Parts, 2. Items per part, 10. Working time, 10 min. 
hfc, 3c, 6¢. 


40. Seeing Trends II—RCP04A. This test is 
similar to Seeing Trends RIO6A. Each item con- 
sists of a group of words and E's task is to find 
the trend in the words. In this test, however, the 
trend is based on the structure of the words rather 
than on the meaning of the words. 

Sample item: 
Anger 


bacteria camel dead 


The first letters go from “a” to “e” 


excite 


Parts, 2. Items per part, 12. Working time, 16 min. 
hfe, 3c, 6¢ 


41. Ship Destination (no code number). Using 
a diagram and observing an increasing number of 
rules, E has to determine the distance between ships 
and ports. In addition to rules of distance, wind 
direction must be considered at the start of the 
test. Later the current direction, the strength of 
wind and current, and the heading of the ship must 
all be taken into account. 

Parts, 1. Items per part, 48. Working time, 15 min. 
hfe, 14. 


42. Sign Changes—CX04B. This test involves 
simple numerical operations in which E must sub- 
stitute one arithmetic operation sign for another 
before performing the operation. 

Sample item: 
In the following problems wherever you see 
— replace it by x 
+ replace it by — 


Parts, 3 


Items per part, 8, 16, 16. Working time, 
1.67 min. 


hfe, 5d. 
43. Sign Changes II—RSM02A. The items 
consist of simple arithmetic equations. In these 
equations the value on the left of the “equals” 
sign is not equal to the value on the right. The 
E’s task is to indicate which interchange of signs 
will make the two values equal 


Sample item: 


1+2=4x1 A. + and 
B. X and 4 
C. + and 
D. X and 
E. X and — 


Answer: E. 


Parts, 2. Items per part, 10. Working time, 14 min 


44. Similarities—RCS01A. Each item consists 
of a pair of common objects. The F's task is to 
write six ways in which the objects are alike 
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hfe, Sa, 15 


Sample item: 


Apple and Orange are alike 


A. sweet 
B. round 


( haz € seeds 


LD. fruit 
E. grow on tree 
F Have SRMS 


Parts, 2. Items per part, 6. Working time, 10 min 
hfe, 2b, 12b, 13 


45. Social Institutions—CS05A. In each item 
the name of a institution is given. The E 


is asked to list two improvements for each social 
institution that is given 


social 


Sample item 
Marriage: 
Courses on marriage in schools 
Social approval of women proposing 
Parts, 2 
hic, 


Items per part, 6. Working time, 10 min 


46. Syllogisms I—ELO1A. The items in this 
test represent 15 combinations of the four figures 
and four moods of the categorical syllogism. The 
E is required to state whether the conclusion is 
true or false in each case 
Sample item 

All soldiers are men. 

Some citizens are soldiers 

Therefore, some citizens are men 
Answer: True 
Parts, 2. 
hfe, 15. 


Items per part, 15. Working time, 10 min. 


47. Symbol Manipulation 11—RSM04A. In 
each item a main statement, presented symbolically, 
is given along with several conclusions 
clusion consists of two parts 
indicate the truth or falsity of conclusion on 
the basis of given definitions of the symbols. 


Each con- 
The E's task is to 


eac h 


Sample item: 
“L” means “larger than” 
“S” means “smaller than” 
“E” means “equal to” 
“NE” means “not equal to” 
If xEy and yNEz, then: 
1. xNEz and yEx 
2. xSz and xLz 
A. Both parts are true 
3. One part is true and the other part is indeter- 
minate. 
C. One part is true and the other part is false. 
D. One part is false and the other part is indeter- 
muinate 
E. Both parts are false. 


Items per part, 15 


Answers: 1 - 


Parts, 2 Working time, 10 min. 


te 
1 
: 
3-6= 18 
6+2= 4 
€ 
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48. Unusual Uses—CN04B. The items are 
names of common objects. Each object has a 
common use, which is given. The E is asked to 
list other uses for which the object or parts of the 
object could serve. 

Sample item: 

A newspaper (used for reading) 

to start a fire 

to wrap garbage in 

to swat flies 

stuffing to pack boxes. 

to line drawers or shelves 

to make up a kidnap note 
Parts, 2. 
hfc, 9b, 13 

49. Verbal Analogies I—RCROIC. This is a 
verbal-analogies test in which there was an attempt 
to make the relationship between the first pair of 
words relatively difficult to grasp and the analogy 
relatively easy to fulfill. 


Items per part, 3. Working time, 10 min 


Sample item 
electricity : 
A color B. 

Answer: A 


energy green 


red C. grass D. trees E. foliage 


Parts, 2 


hfe, 2a. 


Items per part, 15. Working time, 12 min 


50 Verbal Analogies RECO8A 


lhis is a completion form of the verbal-analogies 


Completion 


test. 
Sample item 
cloth house : 


dye paint 


Parts, 


ht 4b 


51 Verbal  Classification—EL16A Vertical 
groups of eight words are flanked on either side 
by vertical groups of four words that define two 
After deciding upon the 
defined classes, / down the 


Items per part, 25. Working time, 8 min 


classes 


nature of the 


goes center column 


of words, checking on the left if a word belongs in 
the class to the left, checking on the right if it 
he longs in the 
mark if the 


one on the right, and making no 

word does not belong in either class 

Sample item 
COW 
HORSE 
GOAT 
DOG 


desk 
sheep 
rocker 


TABLE 
CHAIR 
BOOKCASE 
tree LAMP 
cat 
nose 
dresser 
\ donkey 
Items 
Working time, 8 min 


Parts, per part, 40 (5 


hfe, 2b, 12b 


groups 
52. Verbal Comprehension (no code 
This test is Part | of the Guilford-Zimmern 
Aptitude Survey (short form). It is a 
multiple-choice vocabulary test 


number) 


standard 


GUILFORD, anp P. R 
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Parts, 1 
hfe, 16. 

53. Verbal Relations Naming—RCRO2A. Each 
item consists of two pairs of words. The £’s task 
is to write down the relation that the first word in 
each pair bears to the second. 


Items per part, 40. Working time, 12 min 


Sample item: 
giant 
barrel 


(a) dwarf (b) 
(a) bottle (b) (a) ts smaller than (b) 
? 


Parts, 2. Items per part, 25. 
} > 


hfe, 2a, 6b 


Working time, 12 min 


54. Vocabulary Completion—RECO06A. The E's 
task is to write down a word that fits a given 
definition and that begins with a given letter. 
Sample item: 

A contest of speed 
Parts, 2. Items per part, 40. Working time, 6 min 
hfe, sad, 16. 

55. Word Classification—EL17A. The E’s task 
is to decide which word in a group of four does 
not belong 


Sample item: 
\. horse B. 


Answer: D 


cow C. man D. flower 


Parts, 2. Items per part, 20 


hfe, 2b, 12b 


Working time, 14 min. 


56. Word-Group Naming—RCS02B. Each item 
j The E’s task is 
to write down a definitive name for each group of 
words 


consists of groups of five words. 


Sample item 


knife pan bowl rolling pin strainer 


cooking utensils 


s per part, 15. Working time, 10 min 
, 2b, 6c, 12b 

57. Word Groups 
four words 


words in each 


RPS02A. Each item consists 
The E’s task is to find 
group have in common 


ot a group ol! 
nut what the 
words have in 
al rather than meaningful 


Che things that the common are 


read retire rearming restless 


All words begin with “re” 


s per part, 15. Working time, 20 min 


TESTING CONDITIONS 


had been originally planned that this 
ry of tests would be administered to a 
had been 
1953 to administer 
the battery to aircrew trainees at Lackland 
\ir Force Base, San Antonio, Texas. The 
total testing time amounted to 12 hours 


single sample. Arrangements 


made in December of 


During the interval between the time the 
arrangements were made and the test mate- 
rial was shipped, conditions had changed at 
Lackland Air Force Base. Twelve hours 
of testing time could not be worked into 
the schedule of the trainees and a maximum 
of six hours was offered. The solution was 
to divide the battery into three smaller ones, 
Batteries A, B, and C, each taking six 
hours. It was later learned that the Air 
Force could not work Battery B into its 
schedule so arrangements were made to 
have it administered to naval air cadets at 
Pensacola, Florida. 

An overlapping of the batteries enabled 
us still to test most of the hypotheses, al- 
though with information. 
There was something gained by the fact 
that some factors could come out in more 
than one analysis, hence there was some op 
portunity for replication of results. Two 
tests, Nos. 20 and 46, had to be omitted 
entirely, which meant loss of two tests for 
the factor of logical evaluation. 


some loss of 


Test Administration 


In setting up the batteries, special attention was 
given to the order of administration of the tests. 
seeing that the tests designed for a certain hypothe 
sis were not given consecutively Administration 
manuals provided complete information to test ad 
ministrators. From both testing locations it was 
reported that no special problems arose during the 
test administration and that the examinees seemed 
well motivated 


The Samples 


Batteries A and C were administered at Lackland 
\ir Force Base to 205 and 215 a rerew trainees, 
respectively, in groups of approximately 100 each, 
during the month of August, 1954. Battery B was 
administered to 225 examinees in groups of 30 to 
60 every two weeks during the months of October 
December, 1954.5 At both 


through locations t 


"Grateful acknowledgment is made to the Per 


sonnel Laboratory, HRRC, Lackland 
Texas, and to the Aviation Psychology 
Laboratory, U. S. Naval Air Station, Pensacola. 
Florida, for making this testing possible. In par 
ticular, the authors wish to thank Lk vd G 
Humphreys and J. W. Bowles at Lackland 
Wilse B. Webb at Pensacola. In addition, the 

} wish to thank the military and 
personnel who acted as test adn 


Research 


and 


civilian 
inistrators and 


proctors 
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aviation cadets were typically in their early 20's, 
above the average of the population as to general 
intelligence, and had education of the level of high- 
school graduation or beyond 

Some of the examinees had to be eliminated from 
the study because of 
garding them. As 
201 for Battery 
dattery ( 


incomplete information re- 
a result, the samples numbered 
\, 219 for Battery B, and 210 for 


TREATMENT OF THE Data 
Scoring 


The responses to 20 of the tests were recorded 
on IBM examinees. The 
answer sheets were machine scored and the scoring 
checked 
ing. The remaining tests being of completion form 
were scored by hand and the scoring checked. 


answer sheets by the 


All scores involved a correction for guess- 


lest Statistics 

Reliabilities were estimated using a sample of 
200. Alternate forms and odd-even estimates were 
made for 49 of the tests. For two tests the Kuder- 


Richardson Formula 20 


was used. Other esti- 
mates were obtained from earlier studies The 
various estimates of reliability and their sources 
are given in Table A,* along with means and 


standard deviations of the various test variables 


The Factor Analysis Procedures 


score distributions, which 


checking 
all approached the normal torm, Pe 


correlation 


upon 
irson product- 
coethcients were computed 
r the three batteries. These data 
Tables and ID 


were 


ire presented 


Twelve tactors 
1 
le 


extracted from each of the 


using 
Phe loadings ot the 
iller than 
ind all residuals were less than 05 in 


correlation matrices, urstone’s complete 
centroid method last centroid 
factors were all sm value 


absolute 


20 in absolute 


value. The unrotated factor matrices are pvesented 
n Tables E, } 1G 

The axes were rotated by Zimmerman’s (1946) 
graphic, orthogonal method. The three criteria 
used to guide the rotations were simple structure, 
positive manifold, and psychological meaningful- 


ness. The rotated factor matrices are 


Tables 1, 2, and 3 


presented in 


lables |} ereinatter de signated Tables 


A-G have 


been deposited with the American Documentation 
Institute. Order Document No. 3958 from ADI 
Auxiliary Publications Proje 3 hotoduplication 
Service, Library of Congress, Washington 25, 
L). C., remitting in advance $1.25 for microfilm or 
$1 23 for pl otocopies Make cl ecks pavable to 
Chief, Photoduplication Service, Library of Con- 


gress 
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TABLE 1 


RotTaTED FAacTtoR MATRIX—BATTERY 


H 
EC 


.23 
31 
.02 
.25 
.53 
.04 
O01 
.08 
18 


.40 
.33 
21 
.16 
31 
.12 
.08 
an 
.20 


.28 
.14 
43 


2 
7 


of 
12 
21 


14 
A B ¢ E F G | J K M U 
Vv GR PR CR vc EP SM SS cc (d) R, h? ‘: 
5. —.01 .08 14 13 44 —.06 .09 —.01 —.28 39 
6. .29 .10 40 05 15 .18 17 17 .28 09 57 
11. 04 11 24 25 17 31 .19 05 
12. 39 18 —.09 .06 .10 - — .04 .29 .04 —.01 —.27 .37 
13. 18 54 16 15 .29 07 08 —.02 05 14 63 
14. 12 18 33 —.01 .07 —.02 —.02 —.03 26 19 
16. 13 —.12 .00 —.10 13 26 —.12 14 .02 .09 .28 
17. 22 19 39 a .03 —.10 14 .09 10 34 
18. 01 .25 .20 15 —.08 02 53 .07 —.04 .03 
21. 41 .09 14 .23 11 14 23 51 13 —.06 
23. .08 41 14 .18 36 15 14 .00 04 
24. 08 Al 20 —.02 38 .26 02 .09 07 .03 42 4 
26. 42 02 03 .10 .08 19 —.04 .20 .07 10 33 
a. 02 36 04 .22 32 43 32 .20 —.03 .67 
29, .03 .29 .45 13 ll 09 16 30 .01 —.07 57 
30. .28 —.05 .28 37 15 .20 09 .00 —.06 —.20 50 
34, 07 .26 a .29 21 .14 07 01 .41 08 53 
39, 10 —.04 19 .00 = 06 05 .29 .00 
40. .09 .10 .29 24 12 26 .28 14 17 49 
41. 04 61 .06 18 .00 07 07 03 06 01 .03 46 
42. 08 —.01 19 65 05 04 —.26 
43. —.06 All 14 .06 07 39 .09 07 —.06 47 
47. 08 16 13 .24 08 43 .08 .26 07 
49, 49 16 48 .04 —.02 13 .02 04 .19 .21 .69 
50. 38 .29 16 —.05 35 15 .00 
51. 14 13 30 32 09 .06 07 .29 19 —.05 43 
53. .28 | .29 04 16 18 54 —.09 64 
55. 42 09 04 20 45 —.01 .28 03 05 05 .09 26 
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TABLE 2 


RotaTtep Factor Matrix—Barttery B 


M P 
cc 


3. 
4. 
6. 


5 
5 
5 
5 
5 


15 
A Cc D E F I : 
: V PR PC CR vc SR NA R: Ry h? 
2: 31 42 .09 04 19 16 .20 46 .200 —.01 —.04 51 
3. 11 .20 13 —.09 17 02 40 —.15 
10. 05 16 27 12 14 .03 48 —.13 .00 47 
11. .20 .25 10 .50 .06 44 —.01 .06 03 71 
> 37 6 —.2 14 —.01 12 28 —.07 11 —.10 19 .09 34 
13. 10 .18 .28 .05 21 18 19 —.04 —-.11 .08 —.16 62 
15. 18 30 37 04 .10 .00 .06 14 14 —.05 —.13 04 33 
16. .28 17 .00 12 —.10 07 .00 —.28 —.13 .26 
.13 —.02 —.08 17 13 .07 —.04 42 
53 08 19 05 11 04 29 47 20 24 00 75 
22. —.07 .29 07 27 .14 —.12 67 
29. 29 .19 .06 —.07 15 39 .22 34 .00 47 
30. 15 02 .40 24 24 22 08 06 —.15 —.05 40 
31. 12 —.@ 33 05 07 38 15 —.01 15 15 40 
36. .32 15 25 .09 .12 —.05 14 08 33 
39, .29 .03 —.07 —.03 19 14 34 00 31 
40. .20 15 .04 15 17 .42 08 19 09 12 41 
49. .39 14 .28 43 13 .28 00 .07 —.09 —.05 
: 50. 43 .09 37 15 .08 .22 41 04 —.65 .66 
51. .20 .18 34 40 04 20 18 —.02 —.02 03 51 
.79 01 15 08 12 —.03 10 —.19 05 .09 74 
.28 10 .28 18 32 33 11 20 50 ; 
40 —.09 .20 .16 .20 44 41 04 —.12 06 
.39 00 .29 20 40 .09 ~.10 13 00 05 21 —.01 52 
Jt —.07 .29 38 04 36 13 —.12 0S —.02 52 
11 .28 22 .29 38 09 19 27 12 09 —.17 58 
= 
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TABLE 3 


RotaTep Factor C 


O 


>= 


> 

> 
- 


4 
5 
5 
5 


i 


= 
16 
A I 3 N P Q R 
V SR NA SP Pe AF O Re IF SX Rs Re h? 
1. —.11 05 45 20 17° —.03 .22 01 03 
2. .42 00 — .05 — .09 12 35 — .O8 .20 — .20 .60 
3. 29 15 .24 —.06 —.08 47 02 24 —.04 .07 —.24 .52 
4 18 05 10 04 27 18 47 25 16 —.05 00 .20 50 
07 -.10 .09 .24 .03 .06 06 58 .24 —.09 .08 .50 
8. 16 29 08 23 12 .32 —.08 34 41 .03 —.09 63 
9. 13 04 04 56 30 01 19 23 1s 01 69 
10. 29 09 02 28 61 18 a 03 13 .78 
19, 05 — .03 — .06 — .0O8 .26 .15 .48 —.11 . .03 .10 
22. 00 49 27 .28 —.07 .26 06 19 .09 —.02 .20 —.08 56 
25. .39 17 O01 10 10 05 21 4 —.18 —.18 52 
28. .40 —.05 .16 26 06 18 40 .09 —.08 56 
si. 17 37 .29 07 04 19 —.07 .12 —.08 02 41 
32. 21 25 14 06 16 43 .04 —.04 01 —.18 —.02 40 
33. —.12 — .04 — .20 .06 — .05 .60 —.21 —.15 
35. 02 —.11 —.17 14 01 —.01 18 —.15 24 —.11 16 —.22 26 
36. 22 07 29 01 14 .02  —.08 34 05 00 22 
37. 15 20 .39 —.03 07 40 00 02 17 
38. .13 13 —.04 .50 40 00 14 17 67 
44. 19 10 —.01 24 48 .28 19 10 10 —.06 59 
.06 
60 
.62 
57 
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INTERPRETATION OF THE FACTORS 


The factors will be discussed roughly in 
order of the hypotheses listed earlier. The 
interpretations rest principally upon tests 
with factor loadings of .30 or greater. The 
names and numbers of the tests are listed 
preceding the discussion for each 


factor. 
Following the names of the tests are three 
columns labeled A, B, and C representing 
the three batteries. Factor loadings .30 or 
greater are listed opposite the name of the 
test in the column representing the battery 


Factor A. VERBAL 


Verbal Analogies I 

Word Classification 

Matrix Order 

Inventive Verbal Relations 
Critical Evaluation 

Verbal Analogies Completion 
Verbal Comprehension 
Vocabulary Completion 
Remote Verbal Similarities 
Word-Group Naming 
Associations III 

Logical Classification 


It was expected that some of the tests 
designed for this study would contain ap- 
preciable amounts of verbal-comprehension 
Variance in spite of the fact that an effort 


Factor B, 
A 


Ship Destination 61 
Letter Series 
Sign Changes II 37 (.39 SM) 
Number Series 36 | 


Ship Destination was put into Battery A 
as a reference test for general reasoning 
which had appeared in all four of the pre- 
vious studies. According to most recent in- 


Factor C. Epuction or 


Figure Analogies 

Perceptual Relations Naming 
Completion of Figural Changes 
Figure Matrix 

Figure Analogies Completion 
Figure Classification 


(.53 EC 


(sENERAL 


41 (.36 EP, 40 EC 


PERCEPTUAI 


5 EC, 
(.31 EC) 


in which the factor appeared. If a test had 
a loading of .30 or greater on a particular 
factor in one battery and one less than .30 
in another battery on the same factor, both 
loadings are listed. In parentheses are load- 
ings .30 or greater on other factors. A dash 
in, the column indicates that the test was 
not in the particular battery. A plus sign 
indicates that the test was in the battery 
but that the factor under discussion did not 
appear in that battery. 

The first two factors to be discussed are 


reference factors. 


COMPREHENSION (V) 
B 


39 (.43 CR) 
39 (.40 VC 


37 

(.37 CR, 
79 

40 (.44 CC, 
32 

31 (.38 VC, 
31 (.46 Al 


ibulary level. 
The relatively large number of tests in the 
list that the 


was made to keep to a low voc: 


above indicates this is case 


REASONING (GR 


32 EP, .43 SM, .32 SS 


(Kettner, Guilford, & Christen 
sen, 1956), general reasoning is best defined 


formation 


as the ability to comprehend or to structure 
them. 


problems in preparation for solving 


PR 


RELATIONS 


CC 39 SR, 34 CC 


A 
55. 42 (.45 VC) : 
26. 42 -- 
a. .53 (.47 CC) 
12. 39 
50. Jo (36 CR. 35 CC) $1 CC 
$2. 64 
54. 41 Al 44 (.33 AF) 
36. 22 (.34 Re) 
506. 30 NA 37 (46 NA 
.42 (.36 AF, .35 Re) 
25. 39 Re 
B ( 
41. 
23. ) 
43. 
) 
\ B ( 
13. 54 58 
29. 4 
17. 39 58 
14. 33 
15. 30 PC 
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This factor is the first in the list of fac- 
tors being studied in this investigation. 
There were three tests listed under Sub- 
hypothesis la (seeing perceptual relations) 
—Figure Analogies, Figure Matrix, and 
Perceptual Relations Naming. All have 
significant loadings on this factor in both 
batteries (except Perceptual Relations 
Naming which has a significant loading 
only in Battery A). For this reason this 
factor is called eduction of perceptual re- 
lations and is defined as the ability to see 
perceptual relations. 

Three other tests have significant loadings 
on the factor. One of these is Figure 
Analogies Completion. This test probably 
should have been included under Sub- 


hypothesis la, since the examinee must dis- 
cover the relation between two figures be- 
fore he draws a figure that fits the relation. 
As such it is reasonable to expect that a 
portion of the variance of this test would 
be accounted for by a seeing-relations fac- 
Another test loaded on this factor is 


tor. 


Factor D. 


A 
30. Picture Classification + 
15. Figure Classification 

31. Picture-Group Naming 


This factor is called perceptual classifica 
tion and is defined as the ability to see 


similarities in perceptual material. It had 
been expected that two of the tests—F igure 
Classification and Figure Matching—under 


Sub-hypothesis 1>(seeing perceptual simi 
larities), would define the factor if it 
emerged. Figure Matching had low inter 
correlations with all other tests and as a 
result has no significant loading on any 
factor in this study. Figure Classification 
does have a significant loading on the 
factor. 

Two other tests were listed under Sub 
hypothesis 16. They are tests of the type 
that have been called “structural” in this 
project. Structural tests are defined as those 
that involve simple letters, or 
numbers. The hypothesis that “seeing simi 


symbols, 
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PERCEPTUAL CLASSIFICATION (PC) 


CHRISTENSEN 


Completion of Figural Changes. It was 
expected that the major portion of the vari- 
ance of this test would be accounted for 
by an eduction-of-correlates factor since 
the relationship is given and the examinee 
has only to draw a figure to fit the relation- 
ship. The final test on this factor is Figure 
Classification which is a “seeing similari- 
test. It is possible that relationships 
between figures have to be taken into ac- 
count in classifying them. 


ties” 


In both reasoning studies the list of tests 
for eduction of perceptual relations had con- 
tained tests in which seeing similarities 
seemed to be the main feature along with 
tests in which seeing relations seemed to be 
the main feature. One hypothesis tested 
in this study was that each of these two 
types of tests would form a factor of its 
own if given a chance. This seems to be 
the Factor C involves seeing 
perceptual relations and Factor D involves 
seeing perceptual similarities. 


case, since 


B 


40 
37 (.30 PR) 
.33 (.38 NA) - 


in structural material is the same 
as “seeing similarities” in figural material 
was tested in this study. This hypothesis 
was not substantiated since neither of the 
structural significant loading 
on the factor. 


larities” 


tests has a 

The other tests with significant loadings, 
Picture Classification and Picture-Group 
Naming, were expected to have significant 
loadings on Factor F, verbal classification. 
The items in both these 
groups of pictures of objects. 


consist of 
It was felt 
that seeing similarities in items of this type 
would be more closely 


tests 


related to seeing 
groups of words than to 
arities in groups of figures. This 
seem to be the case. It may be 
figural properties help to determine 


classes of the objects in these tests. 


similarities in 
seeing simil 
CS 


that 


not 


a 


REASONING, CREATIVITY, AND EVALUATION 


Factor E. 
A 
49. Verbal Analogies I 48 (.49 V) 
50. Verbal Analogies Completion 38 
30. Picture Classification 37 
51. Verbal Classification .30 (.32 VC) 


This factor, analogous to Factor C, is in 
the conceptual area and is defined as the 
ability to see relationships in conceptual 
material. The first test in the list above was 
included under Sub-hypothesis 2a (seeing 
conceptual relations). The second test 
probably should have been included under 
that sub-hypothesis since seeing a relation 
should occur before a word is written to fit 
the relation. The other test under Sub- 
hypothesis 2a, Verbal Relations Naming, 
was also expected to have a significant load- 
ing on this factor. An effort was made to 
keep the seeing of the relations as easy as 
possible, however, so that the major portion 
of the variance would be contributed by the 
naming of the relations. A nonsignificant 
loading here indicates that this attempt was 
successful. 


In addition to the two analogy tests there 


Factor F. VERBAI 
A 
55. Word Classification .45 (.42 V) 
51. Verbal Classification .32 (.30 CR) 
56. Word-Group Naming — 
This is the verbal-classification factor 


that corresponds to the perce ptual-classifi- 
cation factor. All three tests in the list 
above were listed under Sub-hypothesis 2) 
(seeing conceptual similarities). They all 
involve the classification of verbal material. 
Two other tests under Sub-hypothesis 25, 
Picture Classification and Picture-Group 
Naming, have significant loadings on the 
perceptual-classification factor (D) rather 
than on this one. The final test under Hy- 
pothesis 2b, Similarities, was not included 
in either Battery A or Battery B. 

A factor called verbal classification had 
been found in the evaluation analysis 
( Hertzka et al., 1954) where it was defined 


as the ability to classify verbal material 


(.38 V, CC) 


EDUCTION OF CONCEPTUAL RELATIONS (CR) 


_B 


43 (.39 V) 

.37 (.43 V, .41 CC) 
.24 (.40 PC) 

34 (.40 VC) 


is a verbal-classification test with significant 
loadings in both batteries. This situation 
is similar to that in eduction of perceptual 
relations where there is a figural-classifica- 
tion test. Picture Classification also has a 
significant loading on the factor in one of 
the batteries. The fact that this test has 
significant loadings on both a_perceptual- 
discovery and a conceptual-discovery factor 
indicates that both properties may be im- 
portant in picture Since Picture 
Classification has a significant loading in 
only one battery, however, this significant 
loading may be due to chance. 


tests. 


As in the case of Factor C, in spite of the 
fact that classification tests have significant 
loadings on this factor, the definition is re- 
stricted to seeing relationships since seeing 
similarities seems to be the unique feature 
of the next factor to be discussed. 


LASSIFICATION (VC) 


B ( 
40 (6.39 
.40 (.34 CR) 


.38 (.31 V, .36 NA) 


The two leading tests in the evaluation an- 
alysis were Verbal Classification and Criti- 
cal Evaluation. The two leading tests in 
the present study are Verbal Classification 
and Word Classification. In spite of the 
fact that these tests were included in both 
studies, the factors in the two studies have 
only one test in common, therefore it is 
not known whether the two factors are the 
same or whether they represent two dif- 
ferent factors. If the two factors are dis- 
tinct, the factor found in this study has a 
stronger claim to the name verbal classifica- 
tion, since the tests with significant loadings 
here to hit 


seem the definition better than 


with significant loadings in the evalua- 
tion study. 


those 
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Factor G. 


5. Circle Reasoning a4 
24. Letter Triangle .38 (.33 EC) 
23. Letter Series .36 (.41 GR, 40 EC) 
27. Number Series .32 (.36 GR, .43 SM, 


A factor similar to this was found in the 
first reasoning analysis (Green et al., 1953). 
There it was called eduction of conceptual 
patterns and was defined as the ability to 
see rules, principles, or systems. All the 
tests loaded on the factor in this study were 
listed under Sub-hypotheses 3a and 3b. 
They all involve seeing rules or principles 
that are more complex than simple rela 
tions. The answers to the items in the 
Circle Reasoning test involve several con- 
ditions and the items in the other three tests 
consist of double and triple series. By con 
trast, the items in the trends tests under 
Sub-hypothesis 3c all involve one relation 


Factor H. 
A 


Figure Analogies Completion 


PR) 


Correlate Completion II 42 (.31 CC) 
23. Letter Series 40 (.41 GR, 
24. Letter Triangle .33 (.38 EP 


.31 (.40 PR) 
31 (.45 PR, 


31 


6. Completion of Figural Changes 
29. Perceptual Relations Naming 
Seeing Trends II 


The two leading here, Figure 
Analogies Completion and Correlate Com 
pletion II, were included under Sub-hypoth 
esis 4a (finding something to fit a given 
perceptual relation). Three other tests were 
listed under this sub-hypothesis. Two of 
these, Completion of Figural Changes and 
Prescribed Relations, are very similar. Both 
involve finding figures to fit a given rela 
tionship. One is a completion test, however, 
and the other is a multiple-choice test. The 
completion test, Completion of Figural 
Changes, has a significant loading whereas 
the multiple-choice test, Prescribed Rela 


tests 


tions, does not. This is not too surprising 
since completion tests have been prominent 
in relation to this factor and since this fac 
tor stresses producing something to fit a 
relation. The last test under 
hypothesis 4a was Figure Analogies. 


given Sub 
The 


seeing-relations aspect of this test seems to 
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EDUCTION OF PATTERNS (EP) 


EDUCTION 


CHRISTENSEN 


B 


32 35) 


that is repeated between succeeding pairs 
of elements. In view of these facts, the 
definition of this factor was changed to the 
ability to see a set of relationships. 

All the tests in the list above can be con- 
sidered to be structural so that this factor 
might be called “eduction of structural re- 
lations.” There were no figural or verbal 
tests in the study similar to these structural 
Thus it is not known whether the 
definition of this factor should be restricted 
to structural tests or not. 
the 


tests. 


For this reason 
factor is called simply eduction of 
patterns pending new empirical evidence. 
oF CoRRELATES (EC) 


B 


.36 EP) 


30 + 


be most 


important since it has a significant 
loading only on eduction of perceptual re 
lations 

wo of the other tests in the list, Letter 
Series and Letter Triangle, are structural 
tests listed in connection with Hypothesis 3, 
which has to do with the eduction of patterns. 
The discovery aspect probably gives them 
a place in the list for Factor G. In each 
the to that he 
knows the system by giving other letters to 
extend the system. Letter Series is a com 
pletion test and, although Letter Triangle 
is a multiple choice test, the extension prob 
lem is still an important aspect of the test 
But the presence of these two tests in the 
list suggests that correlate completion is not 
only 


examinee has show 


test 


a matter of supplying something to 


complete a relationship; it seems also to be 
a matter of supplying something to complete 


a pattern or set of relationships. 
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The two remaining tests in the list are 
Perceptual Relations Naming and Seeing 
Trends II. In neither test is there any need 
to complete either a relationship or a sys- 
tem. It will be noted that these two tests 
were also in Battery B along with Correlate 
Completion II without determining a cor- 
relate-completion factor. This suggests that 
the two tests may not belong in the list for 
Factor H. Reasons for this will be sug 
gested a little later. 

One of the important reasons for in 
cluding the eduction-of-correlates factor in 
this study was to see whether it might be 
replaced by two factors, one perceptual and 
one conceptual. We seem to have an answer 
to this question, for neither of the tests 
affiliated with Sub-hypothesis 4) (finding 
something to fit a conceptual relation) had 
significant loadings on this factor, while 
three of the four tests under Sub-hypothe 
sis 4a (finding something to fit a perceptual 
relation) had significant loadings. The two 


EDUCTION OF 


A 


Factor I. 


Letter Grouping 


11. Correlate Completion II 
40. Seeing Trends II + 
29. Perceptual Relations Naming + 


Word Groups 


All the tests in this list except Perceptual 
Relations Naming are structural tests that 
were scattered among several hypotheses. 
Since we have already seen that Battery B 
yielded a factor of eduction of perceptual 
relations and a factor of eduction of con 
ceptual relations, since all but one of the 
tests in the list for Factor I are composed 
of letters, and since most tests involve see 
ing relations, we are forced to recognize a 
third relations-seeing factor and to give it 
an appropriate name—eduction of structural 
relations. The presence of a figural test in 
the list may reflect the fact that there is 
correlation between this factor 
the parallel figural one. 

All is not otherwise satisfactory with the 
picture of Factor I. Two _ tests—Letter 
Grouping and Word Groups—call for th: 
seeing of similarities rather than for seeing 
relations in the ordinary sense. It is in 


some and 
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conceptual tests largely determine Factor 
M in this analysis. 


Factor H might be called “eduction of 
perceptual correlates” except for the fact 
that both figural and structural tests are 
loaded on it. For this reason it is best to 
call it simply eduction of correlates. Later 
research may that it should be re- 
placed by factors, one for figural 
material and one for structural. 


show 
two 


The presence of the two unexpected 
tests—Seeing Trends II and Perceptual 
Relations Naming—can be accounted for 


logically by reference to the list of tests 
under Factor I, to be discussed next. They 
are both significantly related to the factor 
of eduction of structural relations, along 
with Correlate Completion II. The latter 
factor did not come out in analysis of 
Battery A, as might well have been the case. 
What probably happened is that it became 
confounded with Factor H in Battery A 


RELATIONS (SR 


.50 (.44 CC 

42 

39 CC 

38 49 


teresting that these two tests determine a 
doublet factor in analysis of Battery C, 
from which the remaining tests in the list 
for Factor | are missing. There is a possi 
bility that the factor in Battery C is another 
one, an ability to see classes based upon 
structural material. We have already seen 
that a perceptual-classification factor and 
a verbal-classification factor are 

guished from eduction-of-relations factors 
in Factors D and F. It may be that there is 
also a structural-classification factor distinct 
from a corresponding eduction of structural 
relations. It 


distin- 


this is the case, Factor I in 
Batt ry B is a confounding of two factors. 
Without further however, we 
may for the present accept the two factors 
listed under Factor I as being identical. A 
study way should determine 


evidence, 


now under 


whether there is also a structural-classifica 
tion factor. 
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Factor J. 


Symbol Manipulation .43 
27. Number Series 43 (.36 GR, 
43. Sign Changes II 39 (.37 GR) 


Both tests that were included under Sub- 
hypothesis 5a, symbol manipulation, have 
significant loadings on this factor. Thus, 
the factor is defined as the ability to manip- 
ulate symbols. Number Series was not pre- 
dicted to have a significant loading but it 
is quite likely that manipulation of symbols 
is involved in working this test. Numbers, 
of course, are symbols and it appears that 
some trial-and-error manipulation is neces- 


sary before a solution can be reached. 


Trial-and-error manipulation seems also to 
be a feature of the other two tests with 


Factor K. 


A 
42. Sign Changes 65 
18. Form Reasoning oo 


27. Number Series 


Sign Changes and Form Reasoning were 
the two tests included under Sub-hypothe- 
sis 5b, symbol substitution, so this factor 
can be defined as the ability to substitute 
symbols quickly. This factor differs from 
the preceding one in that no trial-and-error 
manipulation seems to be necessary. All 
that is required is the ability to substitute 
symbols according to simple, given rules. 

As in the previous factor, Number Series 
has a significant loading on this factor but 


L. 


A 


Picture-Group Naming 

56. Word-Group Naming 

39, Seeing Trends + 
53. Verbal Relations Naming : 
28. Object Synthesis 


This appears to be one of the hypothe- 
sized verbalizing factors. The first four 
tests in the list above were included under 
the general Hypothesis 6 (verbalizing 
ability). They call for the naming of 
classes, relations, or trends. The last test 
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SyMBOL MANIPULATION (SM) 


SYMBOL SUBSTITUTION (SS) 


NAMING ABSTRACTIONS (NA) 


.32 EP, .32 SS) 


significant loadings, and the trial-and-error 
aspect probably could be added to the 
definition of the factor. None of the tests 
that were included under Sub-hypothesis 
1b has a significant loading on this factor. 

There is a possibility that this factor is 
the same as the handling-complicated-pro- 
cedures factor found in the general-reason- 
ing study (Kettner et al., 1956) or it may 
be a combination of handling complicated 
procedures and symbol manipulation. An- 
other possibility is that this factor is a 
structural one parallel to logical evaluation. 


.32 (.36 GR, .32 EP, .43 SM) — 


here the finding is not so reasonable. One 
possible explanation is that this factor is a 
combination of symbol substitution and 
numerical facility. Both Sign Changes and 
Number Series involve numbers and Form 
Reasoning generally has had a near-signifi- 
cant loading on numerical facility in pre- 
vious studies. The high loading of Form 
Reasoning argues against the possibility 
that this is entirely a number factor. 


Cc 


38 (.33 PC 
V,..36 VO) 46 (.37 V) 
34 
(.33 CC 
40 (.40 SX) 


in the list above, Object 
for naming objects that fit certain require- 


Synthesis, calls 
ments. On the basis of these considerations 
the factor has been called naming abstrac- 
tions 


22 
B 


This factor is similar to one found by 
Adkins and Lyerly (1951), which they 
called concept formation. The first two 
tests in the list above led their list for the 
concept-formation factor. The factor here 
seems to be more restricted than the one 
found by Adkins and Lyerly. All tests on 
naming abstractions are verbal tests except 
Picture-Group Naming while the tests on 
concept formation included perceptual and 
structural tests as well as verbal tests. In 
addition, all tests that have significant load- 
ings here are completion-type tests that re- 


Factor M. Epvuction oF 


Vocabulary Completion 


The tests with significant loadings on 
this factor are scattered among various 
sub-hypotheses. Since both tests listed 
under Sub-hypothesis 4b (finding some- 
thing to fit a given conceptual relation) 
have significant loadings on this factor, it 
might well be called eduction of conceptual 
correlates. The other tests, however, do not 
seem to fit this interpretation so well. They 
are completion-type tests, but the main task 
in two of them is that of naming an ob- 
served relationship. One of these tests is a 
figural test and one other test 1s a structural 
test. 

One rationalization would be to extend 
the conception of the eduction of conceptual 
correlates to the act of producing words 
that stand for abstract ideas, the ideas being 
given or readily discovered. This conception 
brings us close to the definition of another 


Factor N. 


A 


38. Seeing Problems 
Apparatus Test 
Seeing Deficiencies 
Social Institutions 
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“ONCEPTUAL CORRELATES (CC) 


53. Verbal Relations Naming a 

21. Inventive Verbal Relations 51 (.41 V) 
50. Verbal Analogies Completion 35 (.38 V, 
11. Correlate Completion II 31 (.42 EC 
29. Perceptual Relations Naming 30 (.45 PR 
54. 


SENSITIVITY TO PRoBLEMs (SP) 


23 


quire verbal answers. In the Adkins’ study, 
both completion and multiple-choice tests 
had significant loadings on concept forma- 
tion. Perhaps a portion of their concept 
formation has been segregated in this study. 

A naming factor was also found by 
Carroll (1941). The leading tests on that 
factor involved speed of naming colors and 
speed of naming forms. It does not seem 
that naming abstractions is sufficiently simi- 
lar to Carroll’s naming factor to be identi- 
fied with it. 


B 


33 (.32 N 
47 (.53 V) 
43 \ 


38 CR) 41 (.43 V, .37 CR) 


.44 (.50 SR) 


.34 (.39 SR) 


44 (.40 V, .41 AF) + 


factor—expressional fluency—which had 
been defined as the ability to put ideas into 
words, at the time this study was conducted. 
More recent information, however, fairly 
well indicates that expressional fluency is 
an ability to produce connected discourse ; 
to form sentences with appropriate sentence 
structure. The tests in the list for Factor 
M call for single words as responses, or 
simple phrases, at the most, which fairly 
well eliminates the hypothesis that this is 
the factor of expressional fluency. It seems, 
then, that we have found a conceptual 
factor for the production of correlates, 
parallel to the previously known perceptual 
factor of the same kind. The presence of 
the naming tests may require a somewhat 
broader conception of the factor or it may 
mean some confounding with an unidenti- 
fied factor. 


Cc 
.50 (.40 Pe) 
45 (.51 Pe) 
.39 (.40 Re) 
.38 (.50 Pe) 
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This factor is called sensitivity to prob- 
lems, which has been defined as the ability 
to see defects, needs, and deficiencies. All 
tests that were hypothesized to measure 
sensitivity to problems have significant load- 
ings on the factor here, and no other tests 
have significant loadings. These tests all 
involve the seeing of problems of some 
kind. 


connected with common objects ; Apparatus 


Seeing Problems involves problems 


Test involves problems with mechanical de- 
vices; Social Institutions involve problems 
with social institutions; and Seeing Defi- 


Factor O. 
A 


Apparatus Test 
45. Social Institutions 
44. Similarities 

48. Unusual Uses 
Seeing Problems 


Since this factor has three tests in com 
mon with the preceding one, there is some 
difficulty in distinguishing between the two. 
A clue is given, however, by the two tests, 
Unusual Uses and Similarities, which have 
significant loadings on this factor but not 
on the previous one. Neither is_ strictly 
a seeing-probleras test. The Unusual Uses 
test calls for listing unusual uses for a 
common object, and the Similarities test 
calls for naming similarities between com 
mon objects. 

In the creativity study, Social Institutions 
and Apparatus Test had additional signiti- 
cant loadings on a doublet which was not 
interpreted although it was suggested that 
it might be a trace of a “penetration factor,” 
which had been hypothesized. In that study, 
penetration was hypothesized as an ability 
to see beyond the immediate and the ob 
vious 

Chree 
Problems, 


tests-——Apparatus 


Social 


Test, Seeing 
Institutions—in the 
list above have significant loadings on [ac 
tor N (seeing problems). If it can be 
assumed for three that the 
variance for seeing immediate or obvious 
problems is accounted for by Factor N, then 


and 


these tests 


GUILFORD, anp P. R. 


PENETRATION 
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ciencies involves problems with plans or 
activities. 

In the creativity study (Wilson et al., 
1954), only two of these tests, Apparatus 
Test and Social Institutions, were present 
and had significant loadings on sensitivity 
to problems. Thus the factor seemed to be 
rather restricted. It was included in this 
study in order to test its degree of gen- 
erality by adding somewhat different tests. 
From the variety of tests in the list above 
it appears that the factor is more general 
than had been indicated in the previous 
study. 


(Pe 


B 


actor O might well represent the variance 
due to seeing problems that are not so 
immediate or obvious. It is to be expected 
that those individuals who can see beyond 
the immediate and obvious in the Similari- 
ties test, should be able to produce more 
similarities, and should be able to see far- 
fetched uses of objects in the Unusual Uses 
test. 

The definition of this factor comes fairly 
close to Sub-hypothesis 9a (producing re 
mote responses). It is quite possible that 
this factor corresponds to that sub-hypothe 
sis (see discussion under Factor 53% If 
this is so, one question of interest here is 
why the tests under Sub-hypothesis 9a do 
not have significant loadings on this factor. 
One of these tests is Consequences (remote 
score). Perhaps one reason this test does 
not have a significant loading on Factor O 
is that it deals with things that are remote 
in time whereas the tests loaded on Factor 
© do not. The other three under 
Sub-hypothesis 9a were objectively scored 


tests 


tests whose items involved remote meanings 
of words. These tests are of a different 


than those loaded on Factor (). 


type 


__C¢ 
.51 (.45 SP) 
.50 (.38 SP) 
48 
48 (.35 O, .31 SX) f 
.40 (.50 SP) ; 


A 
Controlled Associations II 
2. Associations III 

4. Vocabulary Completion 
3. Associations IV 

9. Controlled Association 


All tests with significant loadings on this 
factor were listed under the two sub- 
hypotheses under associational fluency. 
They all require the production of words, 
but they vary in several different ways. The 
stimuli are of three different kinds—one 
given word, two given words, or a defini- 
tion. The words to be produced have five 
different restrictions—words synonymous 
with one given word, words synonymous 
with two given words, words fitting given 
definitions, words associated with one given 
word, and words associated with two given 
words. The number of correct responses 
that are possible for each item varies from 
one to many. The number of responses that 
are asked for in each item varies from one 
to twelve. Some of the tests are speed 
tests and the others are relatively more in 
the nature of power tests. None of these 


differences seem to make an appreciabie 
The main feature of all these 


difference. 


Factor Q. 

\ 
Cartoons 
32 Plot Titles (cleverness) 
48. Unusual Uses 

8. Consequences (remote) 
Controlled Association 


This is the originality factor that was 
found previously in the creativity study 
where it was defined as the ability to pro- 
duce remote, uncommon, or clever re- 
sponses. These were the three sub-hypothe- 
for the originality factor. It was 
expected that this factor might be replaced 
by two or three factors if given the chance. 
Such apparently is not the case. The tests 
in the list above represent all three sub- 
hypotheses. Thus it that all three 


eses 


seems 


properties should be included in the defini 
tion of the factor. 
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Factor P. AssociATIONAL FLuENcy (AF) 


B 


A8 61 

46 (.31 V) .36 (.42 V, .35 Re) 
41 (.40 V, .44 CC) .33 (.44 V) 

40 47 

— .56 (.30 O) 


tests is the production of words. For this 
reason, the definition of this factor is given 
as the ability to produce words from a re- 
stricted area of meaning. 


A more recent study in the Aptitudes 
Project (Guilford, Kettner, & Christensen, 
1955) included all tests in the list above 
except Controlled Associations II. In that 
study these tests produced two factors, 
with Associations IV and Controlled Asso- 
ciation leading one factor and with Asso- 
ciations II] and Vocabulary Completion 
leading the other factor. The first factor 
was called fluency and the 
second one was not identified pending the 
outcome of the present analysis. It 
now be suggested that the one 
might have been eduction of conceptual 
correlates, the Vocabulary Completion test 
being in common with Factor M in this 
study. 


associational 


can 


second 


ORIGINALITY (QO) 


A7 
43 

.35 (48 Pe, .31 SX) 
.32 (.34 IF, .41 SX) 
.30 (.56 AF) 


Controlled Association has a significant 
loading on the factor but was not included 
on any of the sub-hypotheses for originality. 
It did have a barely significant loading on 
originality, however, in the creativity study, 
so it is not completely surprising that it has 
a significant loading here. The Quick Re- 
sponse test which was included under Sub- 
hypothesis 9b had a significant loading on 
originality in the creativity study but not 
here. Perhaps this is due to the fact that 
the ‘“uncommonness” key used here was 
not derived from the sample that was tested. 


25 ; 
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Three objectively scored tests were also 
included among the tests for originality— 
Associations III, Associations IV, and Re- 
mote Verbal Similarities. None of these 
tests had significant loadings on the factor. 

The two tests under Sub-hypothesis 9c 
(producing clever responses) have the 
highest loadings on this factor. It is possible 
that this factor should be defined as the ability 
to produce clever responses even though tests 
from the other sub-hypotheses have signifi- 
cant loadings here. It is possible to produce 
clever responses for the other tests that 


Factor R. 
A 
Gestalt Transformation 

25. Logical Classification 
37. Seeing Deficiencies 

2. Associations III 
36. Remote Verbal Similarities 


The two leading tests on this factor were 
among the tests hypothesized to contain 
redefinition variance. Both of these tests 
have had significant loadings on redefinition 
in previous studies. Two other tests, Re- 
mote Verbal Similarities and Seeing Defi- 
ciencies have had significant loadings on the 
judgment factor in previous studies. As 
stated under the discussion of the hypoth- 
eses for redefinition, tests of both these 
factors have come out together on a single 
factor in several analyses. Since the two 


factors have not appeared separately in the 
same analysis, it is not known whether the 
No new light is 
that a 


two factors are distinct. 
thrown on the situation here except 


Factor 


\ 


3 Plot Titles (low quality) 
Consequences (low quality 


Consequences (remote) 


2 
7 

8. 


The two leading tests on this factor were 
included in this study as reference tests for 
ideational fluency. This factor was defined 
in the creative-thinking study as the speed 
of calling up ideas in a situation in which 
there is relatively little restriction and qual 


3oth of the scores for 


ity does not matter. 


IDEATIONAI 


have significant loadings on the factor. If 
only the clever responses had been scored 
in these tests, they might have had higher 
loadings than they did. At any rate, it is 
quite possible that those individuals who 
produce clever responses to these tests pro- 
duce a larger number of responses. This 
would explain why tests besides Plot Titles 
(cleverness) and Cartoons had significant 
loadings on the factor even though they do 
not obviously fit the sub-hypothesis “‘pro- 
ducing clever responses,” and permit the 
defining of originality as “cleverness.” 


REDEFINITION (RE) AND JUDGMENT (J) 


B 


48 
44 V 
- 40 (.39 SP) 
.35 (.42 V, .36 AF) 
+ 34 


factor similar to the previous ones has 
reappeared. 

Rede finition been defined as_ the 
ability to redefine the uses of objects and 
the contents of statements. This definition 
does not fit Tests 36 and 37 very well. 
Judgment was defined in the second reason- 
ing study as the ability to make wise choices 
in a somewhat ambiguous situation where 
it is necessary, in general, to make assump- 
tions and above the facts that are 
This definition fits all the tests in 
the list above except Associations III. From 
all the evidence, it appears that this is a 
confounding of two factors that were prob- 
ably confounded once before. 


has 


over 
given. 


FLUENCY (Ik 


SX) 


the Consequences test have significant load- 
ings. Evidently the low-quality responses 
were not completely separated from the 
remote responses in the scoring, as is indi 
cated by the fact that the two scores have 
an intercorrelation of .39. 


B 
00 
) .58 


Factor T. 


A 


8. Consequences (remote) 
28. Object Synthesis 
48. Unusual Uses 
In the creativity study, spontaneous flexi 
bility was defined as the ability to produce 


a diversity of ideas. In that study both 
Consequences (remote) and Unusual Uses 
had significant loadings. The other test on 
this factor, Object Synthesis, does not fit 
the definition very well 


since only 


one 


FACTOR 


A 


39. Seeing Trends 


34. Prescribed Relations 


41 


No attempt is made to interpret this 
doublet since the common element of these 
two tests is not obvious. 

The remaining factors in the three bat 
are residuals. None has a loading 
greater than .30 in absolute value. 


teries 


DISCUSSION 
Relations of the Factors to Th se 
Previous Studies 
One of these 


found in 


This study had several aims 
the verification of factors 
studies. Eleven factors were un 
Five of these had been found in 
studies in the Aptitudes Project. Four of the five 
appeared in this study in substantially the 
form as before. These factors are 
perceptual relations, eduction of 
lations, eduction of 
(confounded with judgment) 

Five of the six factors that had been found in 
only one study previously were verified. These 
factors are: eduction of patterns, associationa 
fluency, originality, sensitivity to problems, and 
verbal classification 

Facility with verbal relations did not reappear 
In the evaluation analysis, in which it had 
previously found, the relatively large and somewhat 
heterogeneous list of tests related to it made inter 
pretation difficult. Five of the 
in the evaluation study and present in tl 
study proved to have significant loadings on verba 
comprehension, verbal classification, and assox 
tional fluency. The first two of these appeared i1 
the evaluation study. The I 


was 
previous 
er investigation 
two or more 


same 
eduction of 
conceptual re 


correlates, and redefinition 


been 


tests related to 
also 


inference is that the 
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SPONTANEOUS FLEXIBILITY (SX) 


UNIDENTIFIED (U) 


B Cc 


41 (.32 O, .34 IF) 
40 (40 NA) 


31 (.48 Pe, .35 QO) 


answer is required for each item. It may 
very well be, however, that having a diver 
sity of ideas is helpful in arriving at an 
answer to the in this test. At any 
rate, because of the similarity between this 
factor and the one found in the creativity 
study, it is called spontaneous flexibility. 


items 


factor called “facility with verbal relations” was 
a composite of associational fluency plus other un- 
identified factors 

Tests for three reference factors—verbal compre- 
hension, general reasoning, and ideational fluency 
were included as marker tests 
emerged as 


known 


These three factors 
In addition, the previously 
factor of spontaneous flexibility emerged 
even though no marker tests were included for it 

Five new were discovered and 
perceptual classification, eduction 
lations, naming al 
correlates, and 


cation of 


expected 


factors named 
of structural re 
»stractions, eduction of conceptual 
There was some indi- 
at could be called 
“structural classification,” but it was not clearly to 
be distinguished from the new 
Perhaps it is incorrect to say 
penetration is new. Suc! 


penetration 
another new factor tl 
correlates factor. 
that the factor of 
a factor had been some- 


what and a 


anticipated in the study 


doublet factor could have been so identified 


creativity 


Relation of the Factors to the Hypotheses 


The discussion of this subject will follow fairly 
closely the order of dis 


ussion of the hypotheses 
given in the early 


part of this paper. First, some 
more general questions were asked pertaining to a 
few of the factors, 


then some specific hypotheses 
were Stated pertaining to each factor under investi 
gation 


The question of de 


> of generality was raised 


concerning two of the creative-thinking factors- 
ensitivity to problems and originality. In this 
study, sensitivity to problems appears to be some- 


what more general than in the creativity study. It 


pertains to seeing defects or deficiencies in things 
other than mechanical gadgets and social institu 
tions; more specifically, this extends to familiar, 


nonmechanical objects and to planned 


operations 
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As to originality, on the surface it seems that the 
factor is as broadly general as it was before, 
pertaining to the production of unusual, remotely 
connected, or clever responses. The discovery of a 
penetration factor, however, suggests that remote 
associations may be dependent upon a factor other 
than originality or that there are different kinds of 
remoteness involved in tests of these two factors. 

Questions were raised concerning the possible 
identification of two pairs of factors. The first 
pair included associational fluency and facility with 
verbal relations. It was found that the latter factor 
did not emerge, as such, in this study and that 
when previously found it probably represented a 
confounding of associational fluency with other un- 
known factors. The second pair was composed of 
redefinition and judgment. Tests for the two came 
out loaded on the same factor, but owing to the 
lack of traditionally definitive tests for judgment, 
the issue is still uncertain. 

The general question was raised as to whether 
tests that call for classifying activity or the recog- 
nition of similarities among objects would go into 
the same categories as the tests that call for recog- 
nition of relations between objects. From the 
results of this study we have strong evidence tl 
there is a group of 


at 
factors representing abilities 
to classify objects separate from the group pre- 
viously known representing abilities to cognize 
relations. There appear to be as many as three 
in each group, having to do with figural, structural, 
and verbal material, respectively.* 

The introduction of a number of naming tests 
into the study raised the question of whether there 
would be one new factor representing the ability 
to produce names or verbal descriptions for ideas 
or perhaps several new verbalizing factors, or none 
The results seem to be strongly on the side of the 
hypothesis of one such naming or verbalizing 
ability. It does not seem to matter whether the 
thing to be verbalized is a class or a relation or 
a system, so long as it is an abstraction of some 
kind. 

The fate of the specific hypotheses concerning 
many of the factors may be treated very briefly 

Eduction of perceptual relations, The main hy 
pothesis tested was whether seeing relati ynships 
and seeing classes among figural objects call for 
one primary ability or two. The results indicate 
two separate abilities, the other being called 
ceptual classification 

Eduction of conceptual relations. The hypotheses 
and findings parallel those for the preceding { 


fe 


There is a factor of verbal classification, 
the second time. Although there wa 
of it at the 


time this study 


found 
Sno pre lic 


was initiated, there 


emerged a factor that could be identified as “struc 


*It was the results such as these in the present 
investigation that 
attempts to organize the intellectual factors in 


gave the strongest 


impetus t 


system that has been called the “structure 
intellect” (Guilford: 1956, 1957, 1958). 


tural classification,” but since it was a doublet and 
bore apparent similarity to another structural fac- 
tor, it was not accepted as a demonstrated factor. 

Eduction of conceptual patterns. Tests were 
included to determine whether this ability extended 
to discovering rules and principles, also trends, as 
well as patterns. The answer seems to be that it 
pertains to all but seeing trends. Tests of the 
latter type go with tests of seeing relations. A 
trend may be regarded as a linear pattern or a 
succession of examples of the same relationship 
end to end, and hence lacks the complexity that is 
chara tests of this factor. The results 
indicate another kind of conclusion, and that is 
the probable restriction of this ability to per- 
ceptual and structural tests. The qualifying term 
“conceptual” has therefore been dropped from the 


cteristic of 


other dis- 
tinctions being found between tests of figural and 
structural materials, we may naturally ask the 
question whether there should not be two factors 
in place of the one obtained, and perhaps a third 
pertaining to conceptual materials.® 


name of the factor. On the basis. of 


Eduction of correlates. The main hypothesis 
ested was whether there would be two factors— 
perceptual and conceptual—to replace the one that 


een previously found. The results strongly 


ivor the distinction between two, the one being 


conceptual, but the other being heavily featured 
by structural (letter) material. This raises the 
uestion of the existence of a third factor of 
eduction of correlates among figures 
Symbol manipulation. The answer pertaining to 
this factor is that there are two distinct primary 
b es, the other being designated as symbol 
frit ” 
Verbal y abilit The result concerning this 
ypothesis turned out to be one new factor of 
ibstraction naming, which pertains to various 
kinds of tions, as indicated in the general 
discussion 
Sensitivity to problems. This factor seems to be 
little broader t when first discovered, as ex- 
plained in the ieral discussion. 
lssoctational fluen The new, positive infor- 
tion « erning this factor indicates that it can 
tested by calling for few or many responses to 
timulus word The finding of a new factor of 
eduction of conceptual rrelates, however, which 
lso involves the giving of a meaningful response 
hat satisfies a given relationship, calls for some 
kind of discrimination between the two. The best 
sis at present is that the latter factor involves 
ne best or most conventional response whereas 
nal fluency involves a variety of responses. 
This kind of d ination contributed to the 
listinct betwee nvergent” and “divergent” 


’ Subsequent to this study, it has been proposed 
that the well-] vn factor of s } rientation 
s the parallel, fic ] tron ind tl 

neral reasoning 1s the parallel, conceptual edux 
tro patterns (Guilford: 1956, 1957) 


productive thinking, which played an important role 
in the development of the “structure of intellect” 
(Guilford : 1956, 1957). 

Originality. Although, as indicated above, orig- 
inality still seemed to be involved in tests calling 
for uncommon, remotely associated, and clever 
responses, there is some indication that remote 
associations may be also an indicator of the new 
factor of penetration. 

Redefinition. The separability of this factor 
from that of judgment is still an open question. 

Facility with verbal relations. The indications 
are that this factor, which appeared only once 
before, was then a composite. It did not reappear, 
as such. 

Verbal classification. The ability to recognize 
classes of things presented verbally was confirmed, 
with the factor supporting the hypothesis of “see 
ing conceptual similarities.” 


Categories of Factors 


Earlier work in the project, and this particular 
study, recognized the general domains or categories 
of reasoning, creativity, planning, and evaluation 
While these categories have had heuristic value, 
it has become rather clear from the results of the 
present investigation that some new categories are 
in order. The category of evaluation is the only 
one that seems to have persistent value 

There has been increasing recognition that cer- 
tain factors represent abilities to discover informa- 
tion, or to rediscover or recognize it, in the form 
of things, relations between things, classes, patterns 
or systems, and so on. Other factors have 
distinguished from discovery factors by the 
that they involve production of new information 
from given information. They can be called pro- 
duction factors. Within this group a further 
distinction has developed, as suggested above: that 
between convergent thinking and divergent think- 
ing. The former 
response of 
variety of 


been 


tact 


conventional 
latter seeks a 


is aimed toward a 
kind while the 
responses 


some 


It is possible to give the former, heuristic cate- 
gories more empirical meaning by 
new factor-category 
may be defined as relational thinking. We c 
relations, we use relations in producing new infor 
and we evaluate the products of these steps 
in terms of Creative thinki 
seems to depend most directly upon the div 
thinking category of abilities. In a broader 
creative produ 


reterence to 


these concepts. Reasoning 


mation, 


ical consistency 


‘tion, as in ordinary pt 


thinking 


also clearly involves other than divergent 
operations 
Improvement of Tests 


“he third objective of 


incidental than the others ¢ lica- 
tions will be given here concerning the kinds of 
improvements that are indicated for tests as a 
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consequence of 


new information. In addition to 
knowledge of the statistical data concerning each 
test we also learn something concerning its facto- 
rial validity; what common factors it measures in 
the population involved and to what extent. We 
thus learn which tests are best for each factor and 
what secondary factor variances to attempt to 
eliminate in future forms of those tests. We 
learn more about the properties of some of the 
factors so that perhaps new and better types of 
tests can be constructed. The results of this in- 
vestigation carried its expected share of such 
implications. 


SUMMARY 


The main purpose of this study was to 
investigate in the same analysis certain fac- 
tors that had been found previously in the 
domains of reasoning, creativity, and evalua- 
tion. Three major objectives were : (a) veri- 
fication of factors found only once or twice 
before, (b) clarification as to their scope 
and properties, and (c) derivation of in- 
formation that would lead to improvement 
of tests measuring these factors. 

Kleven factors were selected for investi- 
gation, excluding those of doubtful nature 
and those needing more intensive study than 
could be given them in such a general sur- 
vey study as this one. General questions 
asked pertained to the possible identity of 
factors found in different studies, to the 
generality or scope of certain factors, and 
to the possibility that some formerly 
apparently unitary factors might be replaced 
each by two. The introduction of a number 
of tests calling for the examinee to name or 
describe relations, classes, or patterns called 
for hypotheses regarding the possible find- 
ing of one or more new verbalizing factors. 
lor most expected factors alternative hy- 
potheses were stated as to their properties. 

lifty-seven tests were selected, adapted, 
or constructed to test the hypotheses, with 
some of them being introduced as marker 
tests of reference (other than the 
The twelve-hour 
battery had to be broken up into three par- 
tially overlapping batteries. 


factors 
11 being investigated). 
Each battery 
was administered to a sample of approxi- 
nately 200 air cadets, two in the Air Force 
and one in the Navy. Three factor analyses 
were done by the centroid method followed 
by orthogonal rotations of axes. 
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Twenty psychological factors were inter- 
preted, five of which were reference factors. 
Nine of the 11 factors under investigation 
were found in somewhat the same form as 
before, with some clarification as to their 
unique properties. They are: eduction of 
perceptual relations, eduction of conceptual 
relations, verbal classification, eduction of 
patterns, eduction of correlates, sensitivity 
to problems, associational fluency, origin- 
ality, and redefinition (probably confounded 
with judgment). Facility with verbal re- 
lations did not reappear, as such, hence it 
was probably previously a composite factor. 
Symbol manipulation appeared but some of 
the symbolic tests determined another fac- 
tor, distinct from it—symbol substitution. 

Five new factors were found: perceptual 
classification (ability to recognize classes of 
figural objects), eduction of structural rela- 
tions (ability to see relations between struc- 
tural objects, such as groups of letters), 
naming abstractions (ability to name or 
describe abstractions stich as classes, rela- 


tions, and patterns), eduction of conceptual 
correlates (ability to supply a response 
when needed to complete a’ meaningful 
whole), and penetration (ability to see re- 
mote connections or similarities). A doublet 
factor might have been interpreted as 
“structural classification’ (an ability to 
recognize classes of structural objects), but 
it could not be clearly distinguished from 
eduction of structural relations.»° 


A consideration of natural groupings of 
factors suggests that the heuristic categories 
of reasoning and creative thinking would 
be more appropriately replaced by cate- 
gories of discovery, or cognition, and of 
productive thinking. The latter could be 
subdivided into a convergent-thinking and 
a divergent-thinking group. The category 
of evaluation seems to remain useful. 


19 Tn current writings the term “structural” has 
been replaced by “symbolic” and the term “con- 
ceptual” by “semantic” in order to reduce ambigui- 
ties 
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